An Economic View on Human Language Technology Evaluation
نویسنده
چکیده
This paper analyses some general issues about human language technology evaluation, focusing on economic aspects. It first provides a scientific rationale for the need to organize evaluation in the form of campaigns, by relating this need to some basic characteristics of human language technologies, namely that they involve learning to process information in a way which reproduces human capabilities. It then reviews the benefits and constraints of these evaluation campaigns. Borrowing concepts from the field of economics, it also provides an analysis of the economic incentives to organize evaluation campaigns. It entails from this analysis that fitting evaluation campaigns to the needs of scientific research requires a strong implication in term of research policy and public funding.
منابع مشابه
Modeling and Evaluation of Stochastic Discrete-Event Systems with RayLang Formalism
In recent years, formal methods have been used as an important tool for performance evaluation and verification of a wide range of systems. In the view points of engineers and practitioners, however, there are still some major difficulties in using formal methods. In this paper, we introduce a new formal modeling language to fill the gaps between object-oriented programming languages (OOPLs) us...
متن کاملModeling and Evaluation of Stochastic Discrete-Event Systems with RayLang Formalism
In recent years, formal methods have been used as an important tool for performance evaluation and verification of a wide range of systems. In the view points of engineers and practitioners, however, there are still some major difficulties in using formal methods. In this paper, we introduce a new formal modeling language to fill the gaps between object-oriented programming languages (OOPLs) us...
متن کاملThe Correlation of Machine Translation Evaluation Metrics with Human Judgement on Persian Language
Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...
متن کاملThe new structure of economic evaluation Health, Safety and Environment - Management System (HSE-MS) approach to estimate the cost of accident human
Background and aims: Today, the growth of high technology industry faces us to some problems like air pollution, work-related accidents and occupational diseases which make it necessary to use a HSE-MS management system in different projects. However, the implementation of this system need to spend some money and time, so because of the reduced of cost trend in some managers, they regardless of...
متن کاملPolice Interpreting: A View from the Australian Context
In the global village of today, more people have been moving and migrating than ever before creating a need for better communication. Thus community interpreting rose as a specialization serving the needs of members of the community who are unable to communicate with the system. Within this broad field of interpreting the specialist area of legal interpreting assumed a high position. However, l...
متن کامل